An Energy-Aware Workload Dispatching Simulator for Heterogeneous Clusters
نویسندگان
چکیده
This paper presents an energy-aware workload dispatching simulator for heterogeneous clusters. Most clusters in a data center are composed of different kind of machines. Among these machines, the front-end nodes distribute incoming requests to the back-end workers. The main concern in such system traditionally focuses on computation performance, but energy consumption has emerged as an equally important issue recently. This work designs a workload dispatching simulator that is capable of identifying the energy usage of a heterogeneous cluster. The main target of the proposed simulator is to find out how a workload dispatching algorithm affects the energy consumption. The simulator consists of a configurable traffic generator, a workload dispatcher, and a set of server nodes. The traffic generator randomly produces workloads that are constrained by the average job number, and the average job size. The workload dispatcher assigns jobs according to some popular workload dispatching algorithms. Each server node can report its ID, idle power consumption, maximum power consumption, and computing capability. A set of records collected from a real heterogeneous cluster is examined using this simulator. The goal of this work is to develop a simulator that assists data center managers to estimate the availability, service quality, and energy consumption of their heterogeneous computation resources.
منابع مشابه
Adaptive Dynamic Data Placement Algorithm for Hadoop in Heterogeneous Environments
Hadoop MapReduce framework is an important distributed processing model for large-scale data intensive applications. The current Hadoop and the existing Hadoop distributed file system’s rack-aware data placement strategy in MapReduce in the homogeneous Hadoop cluster assume that each node in a cluster has the same computing capacity and a same workload is assigned to each node. Default Hadoop d...
متن کاملEnergy-Aware Aggregation of Dynamic Temporal Workload in Data Centers
Data center providers seek to minimize their total cost of ownership (TCO), while power consumption has become a social concern. We present formulations to minimize server energy consumption and server cost under three different data center server setups (homogeneous, heterogeneous, and hybrid hetero-homogeneous clusters) with dynamic temporal workload. Our studies show that the homogeneous mod...
متن کاملDynamic Voltage Frequency Scaling Simulator for Real Workflows Energy-Aware Management in Green Cloud Computing
Nowadays, the growing computational capabilities of Cloud systems rely on the reduction of the consumed power of their data centers to make them sustainable and economically profitable. The efficient management of computing resources is at the heart of any energy-aware data center and of special relevance is the adaptation of its performance to workload. Intensive computing applications in dive...
متن کاملA Dynamic and Reliability-Driven Scheduling Algorithm for Parallel Real-time Jobs on Heterogeneous Clusters
In this paper, a heuristic dynamic scheduling scheme for parallel real-time jobs executing on a heterogeneous cluster is presented. In our system model, parallel real-time jobs, which are modeled by directed acyclic graphs, arrive at a heterogeneous cluster following a Poisson process. A job is said to be feasible if all its tasks meet their respective deadlines. The scheduling algorithm propos...
متن کاملA Review on Storage and Task Scheduling in Heterogeneous Hadoop Clusters
The task scheduling algorithm for homogeneous Hadoop clusters is incapable of proper utilization of resources in heterogeneous clusters. To overcome this issue, an adaptive task scheduling algorithm has been proposed. With adaptive task scheduling we aim for better resource utilization by dynamically adjusting the workload at runtime. Also we are making the storage of data resource aware so tha...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013